-
Notifications
You must be signed in to change notification settings - Fork 3k
improve: increase default context length and add tests for detecting context length #6214
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
improve: increase default context length and add tests for detecting context length #6214
Conversation
👷 Deploy request for continuedev pending review.Visit the deploys page to approve it
|
@@ -8,7 +8,6 @@ class Anthropic extends BaseLLM { | |||
static providerName = "anthropic"; | |||
static defaultOptions: Partial<LLMOptions> = { | |||
model: "claude-3-5-sonnet-latest", | |||
contextLength: 200_000, |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
removed this from the class because it was already present in anthropic's llm info
✨ No issues found! Your code is sparkling clean! ✨ |
@@ -48,7 +48,6 @@ class Bedrock extends BaseLLM { | |||
static defaultOptions: Partial<LLMOptions> = { | |||
region: "us-east-1", | |||
model: "anthropic.claude-3-sonnet-20240229-v1:0", | |||
contextLength: 200_000, |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
same here, it was already present in bedrock's llm info
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Nice changes!
Description
resolves CON-2295
Checklist
Screenshots
[ For visual changes, include screenshots. Screen recordings are particularly helpful, and appreciated! ]
Tests
[ What tests were added or updated to ensure the changes work as expected? ]